# ORPO Fine-tuning

Schreiber-mistral-nemo-12B is a large language model fine-tuned based on mistral-nemo-kartoffel-12B, focusing on providing more powerful and accurate language processing capabilities.

A Japanese dialogue model optimized through merging Qwen2.5-32B and QwQ-32B, enhanced with Chat Vector and ORPO technologies for improved instruction following

A large language model based on Hermes-3-Llama-3.1-70B-lorablated, fine-tuned on the Gutenberg dataset

Llama3-70B-Chinese-Chat is a large bilingual language model developed based on Meta-Llama-3-70B-Instruct, specifically designed for Chinese and English users, with capabilities such as role-playing, tool usage, and mathematical computation.

Llama-medx_v3.2 is a large language model specifically fine-tuned for the medical field, developed based on the Meta-Llama-3.1-8B architecture. It is trained using supervised fine-tuning (SFT) and odds ratio preference optimization (ORPO) techniques, accurately mastering medical terminology and clinical reasoning capabilities.

A multilingual large language model fine-tuned using the ORPO method, based on lightblue/suzume-llama-3-8B-multilingual

A multilingual large model fine-tuned via the ORPO method based on Llama-3-8B, trained with 50% of the most consistent ranking data, demonstrating excellent performance in various language tasks.